How To Make the Gradients Small Stochastically
نویسنده
چکیده
In convex stochastic optimization, convergence rates in terms of minimizing the objective have been well-established. However, in terms of making the gradients small, the best known convergence rate was $O(\varepsilon^{-8/3})$ and it was left open how to improve it. In this paper, we improve this rate to $\tilde{O}(\varepsilon^{-2})$, which is optimal up to log factors.
منابع مشابه
Mathematical Modelling of Axon Guidance in Chemical Gradients
Correct wiring is crucial to the proper functioning of the nervous system. Key signals guiding growth cones, the motile tips of developing axons, to their targets are molecular gradients. The receptors on the membrane of the growth cone bind stochastically with guidance molecules in the environment, giving an estimate of the direction of the gradient. The growth cone then executes biased random...
متن کاملمقایسه روش‌های شناسایی نوع و مدل وسیله نقلیه با رویکرد کلی‌نگر و جزئی‌نگر و ارائه یک رویکرد جدید
After vehicle detection and vehicle type recognition, it is vehicle make and model recognition (VMMR) that has attracted researchers attention in the last decade. Due to the large number of classes and small inner-class distance, this problem is known as a hard classification problem. In this paper, a comparison between holistic and part-based approaches has been made and most of the previou...
متن کاملProgressive Type II Censored Order Statistics and their Concomitants: Some Stochastic Comparisons Results
In this paper we prove some stochastic comparisons results for progressive type II censored order statistics. The problem of stochastically comparing concomitants of the two progressive type II censored order statistics with possibly different schemes, under different kinds of dependence between X and Y is considered and it is proved that if Y is stochastically increasing (decreasing) in X, ...
متن کاملHow Can a Global Social Support System Hope to Achieve Fairer Competiveness?; Comment on “A Global Social Support System: What the International Community Could Learn From the United States’ National Basketball Association”
Ooms et al sets out some good general principles for a global social support system to improve fairer global competitiveness as a result of redistribution. This commentary sets out to summarize some of the conditions that would need to be satisfied for it to level up gradients in inequality through such a social support system, using the National Basketball Association (NBA) example as a point ...
متن کاملMistakes in cooperation : The stochastic stability of
In an exchange economy with a finite number of indivisible goods, we analyze a dynamic trading process of coalitional recontracting where agents may make mistakes with small probability. We show first that the recurrent classes of the unperturbed (mistakefree) process consist of (i) all core allocations as absorbing states, and (ii) cycles of non-core allocations. Next, we introduce a perturbed...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1801.02982 شماره
صفحات -
تاریخ انتشار 2018